Write realistic Excel tasks drawn from project management work, such as building budgets, schedules, and trackers.
Complete each task yourself to establish a clear correct answer and precise yes-or-no grading criteria.
Contract role for 4–6 weeks, fully remote, with task-based weekly payments.
Aptura is an applied AI and data company that partners with frontier labs to train AI systems on real professional work. They build high-quality evaluation and training environments and work with independent contractors on a flexible, remote basis.
Evaluate AI-generated customer service responses and technical content for clarity, helpfulness, and accuracy.
Validate and troubleshoot JSON structure and formatting against project guidelines.
Provide clear written feedback explaining your reasoning for each evaluation.
Anyone AI creates high-quality training and evaluation data for frontier AI models. This is a part-time, remote contractor opportunity focused on improving AI outputs through expert human evaluation.
Review and annotate AI agent conversations across clinical use cases to assess accuracy, safety, and guideline adherence.
Score and annotate agent performance using structured rubrics and evidence-based protocols.
Identify clinical safety concerns and provide actionable feedback to refine AI-driven clinical agents.
Hippocratic AI is developing a healthcare-only, safety-focused large language model to improve patient outcomes globally. With $404M in funding, the company brings together experts from top healthcare and AI institutions like Stanford, Google, and NVIDIA.
Evaluate conversations between users and AI voice agents for content quality and prosody.
Rate each AI agent turn on a 1–5 scale and provide written justification.
Maintain consistent, well-reasoned ratings with strong attention to detail.
Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.
Listen to recorded conversations between users and AI voice agents to evaluate response quality.
Rate each agent turn on two scales: content helpfulness and prosody naturalness.
Write short, specific justifications for each score given.
Welo Data is an AI services company that provides evaluation and data services for AI voice agents. They are a global organization with a freelance workforce, focusing on quality assessment of AI interactions.
Listen carefully to recorded conversations between a person and an AI voice agent.
Rate each of the agent's turns on two independent 1–5 scales for content and prosody.
Write a short, specific, and clear justification for each score given.
Welo Data provides AI services, specializing in evaluating and improving AI voice agents. They are a growing community of freelancers focused on data quality and human-in-the-loop tasks.
Evaluate AI-generated slides, spreadsheets, and documents for real-world usability and professional quality.
Assess outputs for accuracy, clarity, relevance, and alignment with data science standards.
Provide structured written feedback to help improve AI systems and their outputs.
A partner company is seeking a Data Science Expert to evaluate AI-generated work. The company focuses on improving AI systems and operates with a flexible, remote team.